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Abstract: We introduce a Aon-catCgorical alternative to Wagner'a Abstract Recur¬ 
sive Definition* [Vg-1,2], using a generalization of the notion of clone 
called 3 h-clone, Out more concrete approach yields two new theorems; 
ii The free ti-clnne generated by a ranked set is Isomorphic to the aet of 
locp-tepresentable flew diAgramS with function symbols in the set, 2 . For 
every element of a p-clene there Is an expression analogous to a regular 
expression. Several well-known theorem* of language acid automata theory are 
drawn as special cases of this theorem. 


1* INTRODUCTION 

A common facet of nuch recent research in computer science is the study of 
certain complete l*ttice*, One defines so-called 1 'algebraic 11 elements [ScJ in a 
complete lattice by a fixed-point equation: 

(lUKClO [* ■ F(x)] 

Out aim {as is lWg-l,2] T sj is to "algebraicize" this process? to determine 
the properties of this construction so that we may recognise certain properties of. 
a particular system as instances of seme general properties of fixed-point systems, 
and thus concentrate our attention on the properties which ire unique to the parti¬ 
cular system under study. 

Previous approaches to"this problem have leaned heavily upon categories. In 
particular. upon the notion of an "algebraic theory, 1 " We have felt for some tie-e 
that the introduction of categories at best presents a pedagogical barrier to many 
computer scientists, and at worst may lead so fnva*t£gator to miss important 
result* because of his Imperfect understanding of the notation. We have therefor* 
worked towards developing more concrate rcptesenCations for these mathematical 
structures* While no doubt the most elegant mathematics will come in categorical 
language (and indeed »any of our result* Are atrongly categorical in flavor) it is 
instructive t-0 dec hfrw much can be developed without the explicit introduction of 
category theory. 

In previous work we showed how Pl clones of operations" [Cj could he used 
instead of algebraic theories. Using clones we obtained a development of the alge¬ 
braic theory of automata entirely analogous to the string ca« [Wa], a highly 
transparent proof of the theorem that every algebraic functor has a ’left adjoint, 
and a Jordan-ttolder Theorem for the eminently nonabeliAn category of theories. 

In this paper , ua Apply chase techniques to the study of n flbetract recursive 
definitions*" In Section 2, we define our basic objsct of study, the h-clont. 

Which is roughly Wagner's "set of aeanlnjs of an additively-cLoaad language," In 
Section 3, we obtain a characterization of free ti-clanes in terms of loop- 
reptesantablc flow diagrams, extending a theorem of Ftgot |E] cm finite diagram*. 
This is our hey result, for it enables us to prove theorems About any p-clone by 
considering only the well-known p.—clone of loop-representable flow diagram* 
(regular trees). We note that the normal form theorem of [Ik] nay be obtained 
trivially in thiE way. In Section 4, we ute this result to show that the general 
fixed-point operation e*fl he replaced by a much ™ore restricted fora, in which 
simultaneous equations Are eliminated, We call such a restricted form a "quasi- - 
regular expression" because a fixed point M a single equation is seen CO be 


Analogue CO the Kleene star. Our version -of this theorem. Is stronger than that 
<jf Bekie [Bk]* We draw as corollaries several classical theorems of language 
theory which until now were -considered quit* separately. 


2 . 


DEFINITIONS 


The starting point for Bn algebvaiclsation is the observation that the choice 
of the permissible F’s 1* crucial. Drte can characterize this choice by saying 
that the F’e iiuit he choseo fro(* some done of continuous operations on L (ia the 
TOorphisuis of some theory)* Then the (Fi*i*4-pdnt operation is seen as iu*t another 
closure operation on a set of continueus functions* This leads to the following, 
crucial definition; 


DEFINITIONt Let t be & complete lattice with least element J_, and for each 
niO let V n be a set of continuous functions L" -*■ L* Then V - tjV n is a p-dont of 
operations on L Iff 
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(i) and (ii) guarantee that V Is a clone [C] (to,, the (l,Tl) motphleag of 
theory) r (iii) is a rather general fixed-point operation, Given one 

computes (f ^ (g t >, , pgn) Hx.] p . * h x^ ) as follows; Substitute the x$ into the fixed- 
point equations 

c l^ “ BiCt;, ■ - j’Kgtti |, *,c^). 


solve them, and then take f(cs,*.,<%}* The Tarski fixed point theorem assures us 
that this algorithm yields a continuous function [T] * This is obviously a nota^ 
ttonal variant of the fixed-point operation of [Ug-Z, Sac* II)* The last opera¬ 
tion of taking f of the C + * is of course superfluous; it is included so that all 
our functions will take their values in.' L. A. recurring theme in this paper will 
he the replacement of this operation by more restricted farms, without loss in 
power, (iv) la a technical requirement which we need to provide compatibility 
With theories. Wc say Li* the carrier of V. 

Where IT is clear* we win often omit the infix operator V in (ii), and write 
FfSlP + MBu) ■ If v Is a v-clone* we will sometime* write n(V) for the see V n of 
n-ary operations c£ V, when writing V n would he cumbersome. We will denote alge¬ 
bras by Tiarirs, eg ACT, ACh, Af?r, If A la an algebra* let Car (A) and Ops (A) denote 
the carrier and operations of A* respectively* We call an algebra whoss" carrier 
ia a complete lattice and whose operations are continuous a lattice algebra. Vc 
will use N to denote the set of non-negative integers* * 

p-Clones are ranked algebras in the sense of [Hi],« so we can define' y-clone 
hoaaem&rphisms* U-clone congruences, etc** In the usual way and get all the usual 
elementary theorems. For this paper we will only be concerned with homOmorphismS-* 


DEFINITION; Let ¥ be a p-clone of operations on a complete lattice L* and 
W be * Jj-elona of operations on a complete lattice K. Thao a map h:V * tf ia a 
U-clone homomorphism iff 


1 ) if h(f)e% 
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Evidently h-clonee are closed under Intersection, so we can talk about 
U.C1<A), the least p-clone containing the operations of a lattice algebra A, and 
construct it Itl the u#u*l inductive manner. Our'firat theorem is a non-inductive 
characteriration of HC1(A)+ 

THEOREM 1: (Hemal Form Leona), Let A be a lattice algebra, f tk<yCl (A) ). 
then there exist n,f i ,,. ,f rj In Opa(A) (with r(i)-ary) and a function 
VtN^N ■+ H - {0} anch that if j < r(l), then v(±jj) < r.+k and such that 

f - (e?) M Cgi,-,g n ) 

where 

u. k+n k+n ^ Jf&n 

H = *t '( e va t l)'"» e T(i,r<I)) ) DT R 1 " *v(i.O 

ie, f 1« the first coordinate of the solution of a set of fixed point equations, 
each of which Involves only an operation from A composed with an appropriate tuple 
of projections which "select" the right "Inputs 11 , 

The proof is quite easy, although wo will draw It as a corollary to Theorem 3. 
This ±S similar t* the £*«!$ Theorem Of [k'g-1 Thm 4.7], It is called the "Normal 
Form Lenrca 1,1 because It is Intimately related to normal-form theorems in language 
theory. We will do one simple example to show this connection and 0 slightly har¬ 
der one to show that one can Study ’'non-standard 11 language feature* in this frame¬ 
work, For the rest Of this section, let X be a finite att of terminal symbols' 
and L be the complete lattice of subsets of E * {ie languages ovfcr X 5, 

EXAMPLE 2.1: Three generating algebras for the Context-free languages. Let 
ACh be the algebra whose carrier i* L and whose operaClone *re a* follows: for 
each at £, * 0-aty operation (a), and two 2-ity operations: union and - 
1(S,T) J {at | seS,terJ3 By the Normal Form Lemma, we need only consider sets of 
equations of the form 

Cjl - f*} 

H - oj U c k 
c i " ^ *k 

This we recognise *s Chomtky Normal Form. Thus Oft-iCI (ACh) ) is the set of con¬ 
text free languages over £ + Similarly we can construct ACF &fld ACr- corresponding 
to unrestricted CF graaraara and Gretbech normal-form grammars. The formal form 
theorems" of language theory are seen to he statements of the form ’YiCKA) - seme 
set of language a." Thus V Cl (ACh) “ uCl(AlGr) = tiCl(ACF) ( but Cl (ACh) - Cl(AQF) 4 
Cl(AGr), So the student*s Intuitive notion that Chcasky'a normal form theorem la 
^easier" than Gneibach 1 a ia supported in this theoretical framework. 

EXAMPLE 2.2i Copying Rules, This framework is ideal'for formulating ideas 
About general operations on strings. Here we formulate the Y operation of {M-W] , 
let A have as constant operations the singleton* as before, a 2-ary union, and 
n^ary operations 


F„ - {f w [ve{I,..,n)*j 


where 


This is the algebra of " 10 " substitution: f j j (S> = {ww|w & S}. Tht fa are eWiy 
continuous * so we can talta yCI(A>. O(lCKA)) is a tli.n'nf W^tt.*** 



#1 i , In i _ , w.twvj. j.jj¥ct j c I (VWWULU X JJLI JL ESIT 1 4 

t e have ft number of twsults f*Pr these languages, moat notable an intercalation 
theorem which *ElOwe that {* n b n c n |n>l) is not in the class. Thu* copying of pro- 
par phrase e i* seen to be 4 very week operation)* This is an ay ample of a nen- 
tTiviftl theory whose (0*1) -definition* in the given semantic domain do not form ft] 


3. FEES U-CLQtJES AfH> RATIONAL FLOW DlAOEAMS 

We aesufte the reader is familiar with the complete lattice of flow diagrams 
as developed in [Sc], Ve modify hi* development in the following trivial ways, in 
the spirit of [E] ! 1 . We replace function and predicate symbol* with a ranked 
set fi of symbols which combine functions and predicates, t. We imagine that 
rather than having a single exit, any finite branch of a diagram terminates In a 
positive integer which synbolizes the "return code’* of that exit* just as a 
Wtlon/predicate exit* on a ape cl fled exit line* We are particularly concerned 
with altering the set of primitive symbols and psrmiasib1* return codes* so we 
will use the following notations: E<fl> for the lattice of flow diagrams with sym¬ 
bols in fl; F n (H} for the set of finite diagrams with symbols in fl p 1 appearing 
only at bh 1 ts 1 and with exits in (1*.* *n)j and for the E ec of diagrams 

representable by loops with the *ams symbol ftnd exit conventions as F We 

refer to a loop-pep recent able diagram, as a rational diagram. 

Mpt * t J at "idtn) £ ^ dofine StftJ) to be the disjoint union of the ^ 

RfiiSiK R(R) is thua * r*nked set: tvery element has a unique arity. We simiiar- 
ly define the ranked set F(fj) of finite diagrams » the disjoint union of the 
FnlW* 

Consider the algebra A whose Carrier is E(f!) and which has for each fcO* H n 
n-ary operation C f given by Cf(d t , ' 



Ws will also have occasion Co discuss 
. p-dq) is the diagram fumed by 
copy of diagram. d ± * Since exits occu 
Operation is always well-defined. 


ftsion Co discuss C^, where d i?i any 'n-ary flew diagram* 
liagram fumed by attaching to oach exit o£ d numbered i a 
Since exits occur only at the end of finite branches this 

n 1 T J.-. f J _a. j_ 3 ' SP 











THEOREM h yCl(A} * { C,j ]-dettCO) } {with th* natural ranking) 


PROOF: UC1(A)C Ji(fl) ; The. proof follow# the inductive construction of 
|iCI(Aj- Pot each C{£Ops(i) t f = Cj, where d is the diagram 

'V 


GAD 


C TJ 



and tOf) w (C E Pi Cgj^> “ t, wh.tr* d’ la the diagram represented by 



{where In th* induction steps t f, gl^.^gn are ail diagrams already defined in 
yCi(A», 

Mfl) C uCl (A) : Given a rational diagram d, take any loop representation of 
it, Humber Che boxes in the representation 1,,, h n > Including the exit nodes, and 
number the first box executed h Typical Fragments of the flow chart look like: 



The fixed point equations are 


^ “ *j 

c i = f(c Ji^.p t i P > 

So C d - where 

ii - Cf(eJ35 |lf » t 4tJp) 


or to 


.k+n 


QEJJ 


Because of thi« hijaction we can speak of R{fl) a# "the U-clone of rational 
diagrams. 11 It will be helpful to shew some examples* Following this bljectionj 
we will often write d for Cj, 





























EXAMPLE 1.1 


f<s(*Leb,h(*b> 

EXAMPLE 3.2 represents the diagram 

<Wd)[d - >&<**,«!»] 

The arguments to the fixed point 
equations are (x^k^Cj ) . So 

d = {eb u (f(s<el,e|),h{e^*!))> 

EXAMPLE 3,3 

The algorithm gives 

Ci ■= f(c lt c a > 

Ca ■ 

The argument vector is 

Ui,o (l c s ) t Eq 

d = 

By inspection , ve also have 

d = <(el) U <f<eLeb)H(*h U (En 

In the last example, wt acc that, In general, there are many expressions for 
the ga^ (not Just equivalent) flow diagram. He Hill study this phenomenon In 
mom detail In the next section. 

He are now ready fox our first major result; 

THEORY 3j K(iJ]l Is the free p^clone generated by £!, that lei if V Is any 
y-cLona and j is & rank-preserving (flap j :ft ■* V, then J extends uniquely to a 
pr-clone hoBOfflttxphiam J*:R(ft) ■* V. 


PROOF: Ha extend j to j* as follows; 
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(i) - (111) extend j to a well defined nap on F (ft). Further, j * | F(C1) i® a 
clone hoffloreniphifla F(ft> -+ V, ie, If d^E^fft), d 1> ...,d n Fp(ft), then 
j*Cdfl(d J,.. .d n )> - (J* (d-j,))^(j 11 (d j) ..»J ■ (d n )) * since F(ft> under Composition la 
clearly IsoBorphic to tha ranked aet of ft-troes under Substitution* which la just 
the free clone generated by ft. We note that each approxlmant (In the sense of 
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|Sc, Sec* 3]> to a rational diagram in in F(ft) (ie, it has no embedded This 

ia enough to (bow that 3 * is well defined on E(E1)» 

He must now show that J* la a U-C-lone heafioinorphlsBi. From that It also folk¬ 
laws that the imsgr of J* is in V. J* is clearly rank preserving and preserves 
projections and J_* It also preserves compositions on F(I3)* To show that it pre- 
serves composition in general, let F n (d} denote the n-th epproximant of d + It is 
easy to see that if djGR^), then 

Pi W fl Mi,., r^n)) £ {Pi <d ( )) (Fid, > ,.. f Pi(d„)> £ P 2 (d 9 £d, ,. . , d a )} 

This gives tht second equality In 

j*{4 D (d l *w i d n >3 - j*(U i F 1 {d a (d 1 ,**,d n ))) 

- l*<U t ( (Pi(d D » (Fi(di > (d n ) ))> 

• U Cd,»CFi(dj ) , ♦, *Pl(d n ) >) 

- UiO*<Fi(d*)»(J*{P ± (d 1 »,.. J j*CPi(d a ))) 

- {UiJ*£Pi( 4 ]»> (UiJ*CFi(d 1 }),,.*Uij*{Pi(d n ))) 

- Ci*(UiFi{d 0 )» v {jMUiP J (d 1 )),..,j*(U ± P t (d fl ))) 

- (j*C^)) V (j*(d l ),. t ,j*(d n » 

(The fifth -equality follows from the feet that u is a ties Lire operation in 
[L K - U), TO show that j* preserves fixed-paint, far any clone V define a func¬ 
tion C;(l, ., ,n}xKxf l ! f | t+tl J‘ P ■+■ by induction on the second argument, art follows: 

. 1 “ i8u) D J_ 

k k 

C<iiP+ljSi*- -. K n > - , ■,0{n,p i g l >,♦,&„)) 

Tarski’s fixed point theorem then yields that 

^ ^ {fii »■ * * > Bnl = f {bJ p'C(ljP,g, a ■ + 1 $^) * * * { n *F 1 ■ * * 

Fiirthermore, fron the properties of J* already known, it is easy to prove by 
induction on p that 

jMcd^.^p.-A)) = q(i,p,i*(d 1 ),**,j*(d a )J 

and 

C(ip,p , 1 £ C(i l p+'l,g| ,. f P gjj} 

So then 

j»(d ( u Cd it , ip d n » - jMdp(UpC(i J p,d |tl . t d n > 1 ., 1 UpC( n ,p,d ltl .,d n »> 

“ (J*£4^J) £j*CLjptJ(lpP|d 1 i--id n J) , .,,J*(1JpCfn,p)) 

“ (J*{-3,»(UpJ*(Ca,p 1 d l ,*,,d n )) J .,,Upj*{CCn,p 1 d M , tI d n ))) 

- tj*(d,»£UpC(l, ? ,j*£d l ),.,,j*£d n )),.. 1 UpC(n fcPl j*(d l ) > ** 1 

J*td n H) P 

1 

last, we must show j* is unique. It will suffice to show that if h is s 
U-clnne homomorphism R(G) + V, then h * (hjft)+* This follows by an easy induction 
Oh the iterative construction of pCl(A), QED* 

We are now able to prove theorems about any JJ-clcme by considering only the 
p-elone of rational flow diagrams. For example, the Hormal Form follows 

immediately frees the ccnetruction of the second half of the proof of Theorem 2 
(Compare, for example, the lengthy proof of IEkJ>. In the next section we show 


hD uns of the power of this technique, Ue conclude this section with a technical 
result ue will need Co apply the thwrtnu 

CxJucmuUCy t Lee R$ denote the forgetful functor sending any p-tlene to the 
ranked set of it* operation*. Then there Is * natural Injective y-clone horno- 

- 'teorphi« J:V + RCRStv)) 


t, TUO NORMAL FOJfrt THEOREMS AHD THEIR APPLICATIONS 


Id this section we apply Theorem 3 to get two more normal form theorems for 
the p—clone of a lattice algebra. Our first theorem, which was also discovered 
by Sekic [Bk] t Is a 11 Currying Lemma 11 for the fixed—polot operation; It say a that 
any simultaneous iteration (e fl )^(f 1% .,„£ n ) can ba replaced by a sequence of Itera¬ 
tions Involving only a single equation, Due second theorem strengthen* this 
result by specifying that the only peraissible functional compositions be of the 
form where gEcOp* (A) * He conclude with a series of corollories t 

including several classical theorems* 

NOTATION; We write ¥<f) for (e|> W (f). 

LEMMA 1; Let £! be a ranked alphabet. Let g] r ■ • - Ff n E!l ^k 1 M • Then in R(fi) 

(ef- J >H { Sj (e ^- 1 , . ,. * ,Bn-l ^ j!+n ‘ 1 > ■. A^-l *^Sn) 

PROOF: The left-hand side represents the flow diagram represented by 




The second flowchart Is obtained from the first by shaking separate copica of the 
— gn box for each oE g 1 ■ ■.** These both clearly represent the unique flow dia- 
gran in R(fl) which starts with £ 3 and which has the property that lunnediately 
below each node Is the tuple of nodes marked egits 1*,.,k,g 3 t ,,,g n . 




















































LKfftiA 2l Let V be a p-clons,, £!*..*f n eVk+n* Then 
(eT^tf.. ■ 




PROOF? Lvfc J be the natural insertion V -r R(RS(V)K Then j of the left-hand 
side equals j of the right-hand side,, applying Lcirana 1 In R(R5(V)), Then the 
lema fellows since J 1 b an injection, 


THEOREM 4? (Settle) Let A be a lattice algebra,ftpC!(A), Then there lg an 
expression for f in which the only occurrences of ^ art of the form (ej)^(g)i 

PROOF: Call an occurrence of V ftpod Iff it la of the allowable form; call an 
element of PCI (A) good Iff It has an expression In which every occurrence of ^ is 

_^good. If are good* then h - (e? )^(g) * * * ,g n ) Is good* by induction on n: 

If n = 1, h la good by definition* If n i* p+1* by Lemma Z there exist good 

£i*--i.fp auoh that h m (ef" l )^(f ( *. * ,fp)„ which i* good by the induction hypo¬ 

thesis. How by Theorem I, for every ftpCl(A) there exist gi,--,.6n ^hich are good 
(indeed* they have no occurrences of V) such that f 11 (e^Vf^ * + + *g rt >* QED. 

LEMMA 3. Lat fE^ n ^, ,gi T , ■ jgnefJic. Then in R(ft) 

( (Y ( f J) (s i i - - t £n J “ ^ (T (.ft i ± - * * £si fc e k+.i ^ ^ 

PROOF; Loth expressions represent the same flow diagram as dots 



i* t the unique diagram, Starting with f, such that the immediate descendants of 
each f are end the immediate dee pendents of each gj are exits 

LEMMA 4* Let V be any y-clcne, fE^ ri + | j # * ■ tg n c v k- Then 

(¥<f)> V <B,j-. 1 fin> = *<£*(*! 

PROOF: Apply Lemma 3 in R(RS(U)>, 

THEOREM 5i Let A be a lattice‘algebra* f£V » UC1(A)„ Then there ia an 
exp re e b Ion for f in which the only occurrences of ^ are of the for* (ei)^(t) and. 
the only occurrence? of V are oi the form g^(t|,,+ ,tn) whett gEOps(A)* 


PROOF: For an expression t satisfying Theorem 4 and a subexpression t" of 
the fona f v fg, , ■ . ( g n ) l fi t d<t p > equal the number of occurrences of ^ or If in f * 

Let ]t] denote the Sum of the dCt*) for all the subexpressions fc 1 of the fern 
f V (*l ... , 5 ^). Then the fallowing two rules Send t h in expression t 1 equivalent 
to t and such that |t'[ < | t[ . 

RULE 1: Replace a subexpression of the form ((T(£))* {gj * .. *g ) (where gitV-uj 
by Y(f v (gj ,..,g n ,e^)) 

RULE 2 : Replace a subexpression of the form (f V (gj , .. *g fl ))^(1^ t , , ,hu) by 

£g] m* ‘ ifyt) i ■ * iSn^l . * . jhj^) ) 










Th*6* preserve the vslua Qf t by Leasa 4 and by tte definition Of \ By the 
previous observation, any sequence of applications of Ruleji 1 and 2 must terminate, 
leaving an expression in which each left-hand aide uf * ^ is either an operation 
in A or a projection. So now apply 

RULE 3: Replace a subexpression of the form f’t&n) h y Si 1 * 

Since Rule 3 is length-decreasing, it too must terminate, leaving an expres¬ 
sion which satisfies the theorem. QED. 

DEFINITION E An expression satisfying Theorem 5 is said to be quasi-regular . 

COROLLARY 1 (Kleone)! Th* regular sets and languages generated by right- 
linear grammars coincide. 

FRO OF! Apply Theorem 4 to the Li-clone generated by the algebra whose opera¬ 
tions on the complete lattice of £ -languages (L of Examples 2.1 and 2*2} ate 
& W as for each £ E , 

COROLLARY 2: The cent ex t-froe languages are cloned under substitution, 

Symbol iteration, and nested iterative substitution. 

COROLLARY 3 (HcVhirter [McW]); Every context-free language is obtainable 
froH the ainglatOPS by substitution* union, and symbol iteration. 

PROOF: Apply Theorem 4 to JiCi{AGF}, 

COROLLARY 4 (Crudkn [Cr]): Every context-free language is obtainable from 
the singletons by concatenation, union, and symbol iteration. 

PROOF t Apply Theorem 5 to fjCl (ACh) „ 

COROLLARY 5 (Engeler fEn]): For every flowchart'program there is a aide- 
effect equivalent flow chare program in ''normal form". 

PROOF: Apply Theorem 4 to R(SJ). 
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CORRIGENDUM: 


The Corollary to Theorem 3 should read: "There is a natural map 
J.:V — P-R(R$00) *nd a datura! UClone homomorphism k: RfRSOD) V 
such that k(J(x)) » x* M 

In Section 4, the proof Of Lemma 2 should read; 

"Let LHS{t ,„,l ) and denote the left-hand and right- 

hand expressions with t^ substituted lot Then 

LRS<f l ....f n ) - (by the Corollary to Thm 3) 

- k(LHS<j<E 1 ),.. ,j Caine* k is * homomorphism) 

- k{B|(j(f l ) ( . 1( J{y) (by Lemma 1 in R(RS{V» > 

- RH5<f ....f )* 

The proof of Letumo 3 should refer to this proof. 


NOTEi 

111 Section 1 we said "It is instructive to see how much can he 
developed without the explicit introduction of category theory• " 
Subsequent developments have convinced us that the results developed 
herein represent close to the limit of what can be done without 
the explicit categorisation. We expect that any extension cf these 
notions will indeed requite categorical language, In particular, 
our Theorem 3 la a special case of a much more general theorem, which 
is proven much more easily l 


